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Abstract 

If 21 is a finite alphabet, lA C Z^, and is a probability measure on 
21^ that "looks like" the marginal projection of a stationary stochastic 
process on 21 , then can we "extend" nu to such a process? Under 
what conditions can we make this extension ergodic, (quasi)periodic, 
or (weakly) mixing? After surveying classical work on this problem 
when D = 1, we provide some sufficient conditions and some necessary 
conditions for to be extendible for Z) > 1, and show that, in general, 
the problem is not formally decidable. 
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1 Introduction 



1.1 The Markov Extension in Z 

Let 2t be a finite alpiiabet, and let 21^ be the space of bi-infinite se- 
quences on 21. A stationary stochastic process is a probability 
measure /i on 21^ so that, for any F e N, bo,bi, . . . ,bv & and any 

fc G Z 

l^{ae^^ ; ao ^ bo, ■ ■ ■ ,av = by} 

= ij{a.G^^ ; ak = bo,.-.,ak+v =bv} 

Let U be the interval [0...[/] C Z. The projection map pr^^ : 
2t^ — !■ 21^^ is the map sending the sequence [a^l^gg] to the sequence 
['^"Iriew]- With this map, we can project fi down to a marginal 
measure, fiu := pr^ [/i], on the space 21^^. This marginal is then 
locally stationary: for any V < U, any bo,bi, . . . ,bv & 2t, and any 
fc G Z so that V + k<U also, 

{a G 2t" ; ao = bo,...,av ^bv} 

= /UiY {a G 21" ; a/c = 6o, • • • , a/c+y = by} 

Can we reverse this process? Given a locally stationary measure 
Hu upon 21^^, can we extend it to a stationary stochastic process ^. on 
21^, so that pr^ [/i] = /xjy? Yes, and furthermore, wc can do so in a 
canonical fashion, via the so-called Markov Extension. 

An intuitive description of the Markov Extension is this: We ran- 
domly "choose" the coordinates ao,...,ar/ according to the proba- 
bility measure nu. We then randomly chose the coordinate au+i, 
again according to nu (now treated as a probability measure on 21^^+^), 
but conditioned upon the fact that wc have already fixed coordinates 
ai, . . . ,au- Next, we randomly chose the coordinate again ac- 

cording to ^.u (now treated as a probability measure on 2t"+^), but con- 
ditioned upon the fact that we have already fixed coordinates a2, ■ ■ ■ , ctu+i ■ 
Inductively, we get a J7— step Markov process on 21. 

To formally construct the Markov Extension, we need a bit of no- 
tation: 

• If a = [a„|„gz] is an element of 21^, and V C Z, then let 
av := Kl„£v] 
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If is a measure upon a^, V C Z, and b e 21^, then let "/u[b]" 
denote the measure of the associated cylinder set: 



At[b] := ^ {a G 21^ ; ay = b} 

• Suppose V C Z and k & Z are such that (fc + V) C U. lib := 
[&t;|„£v] element of 2t^, then let b' be the "shift" of b by k: 



that is, b' := 
Then define: 



v\ve{k+V) 



, where, for all t; G V, b'^ 



bv- 



Hulh] := /it/{a€2l"; ai^k+v) = b'} 

(because iJ.u is locally stationary, it doesn't matter which k we 
use in this definition, if more than one k is available) 

The Markov Extension of is the probability measure Hmrit, 
where, for any JV > [/, and b G -^1, 



Mr™*;[b] := 



N-U 



k=l 



b[fc...[/-ffc] 



>[fe...C/+fc) 



Here, [k...U+k) := {k, k+1, 



{k, k+1, 
bility: 



k + U}, and jiu 



■ U+k] 



^[k...U+k) 



k+U-1}, while [k...U+k] := 
is the conditional proba- 



3[fc...C/+fc] 
>[fc...!7+fc) 



m [b[fc...c/+fc]] 

I^U [b[fc...;7+fc)] 



/Ltmrfc is a stationary probability measure on 21^. Define the prob- 
abilities of cylinder sets indexed by negative coordinates by simply 
shifting them into the positive domain. Thus, iimrk is defined on all 
cylinder sets in 21^. It is straightforward to check that the probability 
measure thus defined is stationary, and that its marginal projection 
upon 21^^ is equal to jj^u- 

This construction indicates that a stationary extension of the mea- 
sure i^u always exists. In general, there may be many such extensions. 
Intuitively, ^rmk is an extension built so as to provide the maximum 
amount of "random choice" at each successive coordinate. Hence, the 
following variational principle is not too surprising: 



Theorem: Maximal Entropy Property 

Of all the different stationary extensions of jiu that exist, ^rmk is 
the one possessing the largest process entropy, which we define as: 
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H{firr^) lim — [a] logj (a*™* [a] ) 

Proof: See, for example, □ 

Under what circumstances do ergodic extensions of exist? Can 
we build an extension measure which is supported only on periodic 
words of some fixed periodicity? Also, what happens if lA is not just 
an interval inside Z? 

1.2 Extension on Lattices 

Now, let Z? > 0, and let be a D— dimensional lattice. Then 21^ is 
the space of D— dimensional configurations on 2t. If k G lP , then the 
shift by k is the map i5i/t : 21^ — ^ 2t^ so that, if a := [anlnezo]i 
then iSL'fta := [anlj^^^c] , where = fln-k, Vn e Z^. 

A stationary stochastic process is a probability measure fji on 
21^ that is invariant under all shift maps. That is, if V C Z-° is any 
finite subset, and b e 2t^, then for any k G Z^, 

ii[S^n{h)\ = ^Ji[h] 

liU C Z^, and k G Z^, then define ^^f^U = Z^+k, and define : 
_^ ^u+^. 30 that, if a := [a„|„g^] , then 5.^a [a^new+k] . 

where a'^ — a„_k, Vn G + k. A probability measure on 21^^ is 
locally stationary if for any V C any b G 21^, and any k G Z^ so 
that ^ftV <ZU also, 

The Extension Problem: Given a locally stationary measure 
fxu upon can we extend it to a stationary stochastic process ^ on 
2t^" , so that pry [fi] = fiu? 

The Extension Problem does not always have solutions, as examples 
in Section |^ will show. If we can solve the Extension Problem, can we 
construct an extension which is ergodic? (quasi) Periodic or (weakly) 
mixing? 

1.3 Extension on Group Modules 

Now, let G be an arbitrary group, and let be a G-module: an 
arbitrary set equipped with a G— action. A few examples of this to 
keep in mind: 
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• A4 -.^ Z and G := Z , also, acting upon Ai by translation. 

• M := (Z/Pi) e (Z/P2) ©••■ (Z/-Pd), and G := Z-° acts upon 
A4 by translation with periodic boundary conditions. 

• G is an arbitrary group, H an arbitrary subgroup, and A4 := 
G/H is the set of right cosets. G acts upon A4 by multiphcation: 
if g e G and (kM) e M, then g.(kH) := (g.k)H. (Every 
transitive G— module is of this type, and every G— module can 
be written as a disjoint union of transitive G-modules.) 

Let 2t^ be the space of M — indexed configurations on 21. If g G G 
then the shift by g is the map : 21-^ — > 21-^ so that, if a := 
[onilmGAi]' thcn.5|a := [aj^l^^^] , where a;„ = Og-i.^, Vm £ A^. 

A G-invariant stochastic process is a probability measure /j, on 
21-^ that is invariant under the shift action of G. That is, if V C 
is any finite subset, and b £ 21^, then for any g e G, 

^i[^^{h)\ = M[b] 

liU C M and g £ G, then define 5|tW = g-^ = {g-u ; u £ U}, 
and define i^St ■ — > Sl^'" so that, if a [a„|„g^] , then ^itS := 
[a^l^gg^] , where = ag-i.„, Vueg.U. A probability measure /^;^ 
on 21^ is locally stationary if for any V subset U, any b £ 21^, and 
any g £ G so that ^f^V C U also. 

Again, we ask: 

The (group module) Extension Problem: Given a lo- 
cally stationary measure jin upon 21^^ , can we extend it to a stationary 
stochastic process ji on 21'^, so that pr^ [^] = ^u? 

If A4 = iP = G, then this is just the Extension Problem on a 
D-dimensional lattice. If M := (Z/Fi) © {I/P2) © • ■ • {'^/Pd) and 
G := Z^, then a G— invariant measure on 21"^ is "equivalent" to a 
stationary stochastic process on 21 which is supported only on peri- 
odic configurations with fundamental domain [O...P1) x [O...P2) x . . . x 
[O...Pd). In Section ||, we will demonstrate that, if W C [O...P1) x 
[O...P2) X ... X [O...Pd) C is some "small enough" domain, then 
any locally stationary measure ^.u can be identified with a locally in- 
variant measure ^iw , where W d Mis the obvious "representation" of 
U inside M. 
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1.4 Organization of this paper 

In we motivate the Extension Problem by discussing applications 
to the Invariant Measure Problem for subshifts of finite type and 
cellular automata. In we show that the Extension Problem is not 
trivial by providing examples of locally stationary measures which can- 
not be extended. These examples imply two necessary conditions for 
extendibility: the Entropy Condition and the Tiling Condition. 

In we review basic harmonic analysis on configuration space, 
treating it as a compact abelian group, and characterise the Extension 
Problem in terms of constructing a suitable set of Fourier coefficients. 
We use this in §||, where we consider extension on finite G-modules, 
and show that, if v is an extendible measure with full support, and fi 
is "close enough" to then is also extendible. A similar result can 
be developed for constructing periodic extensions, but first we need 
a tool to "reduce" the Extension Problem on an infinite module to 
an extension problem on a suitably chosen finite module, which we 
develop in via the concept of "envelopes" . 

In §^ we show that an extendible, locally stationary measure with 
full support can be "embedded" in any ergodic Z^-dynamical system, 
in the sense that it is a marginal projection of a stationary Z^-process 
generated by a partition on that system. 

In §|[ we combine the results of §|| and §^ to investigate when a 
measure has an almost-surely periodic extension, and provide examples 
of measures which never have periodic extensions, as well as measures 
which only have periodic extensions. Then we use the results of §0 to 
show that "almost all" extendible measures have extensions which are 
ergodic, mixing, weakly mixing, or quasiperiodic. 

In we show that the Extension Problem is, in general, formally 
undecidable. 



1.5 Preliminaries and Notation 

If we treat 21 as a discrete topological space, and endow 21^ with the 
Tychonoff product topology, then 21^ is a compact, metrizable space. 
If M is finite, then 21^ is finite and discrete. If is infinite, then 
21^ is uncountable and totally disconnected. 

The topology on 21"^ is generated by cylinder sets. liU <Z M. is 
finite, and b e 21^, then the associated cylinder set is: 

{a e 21-^ ; ai^ = b} 

Here, by "aj^" we mean the element [flu Lgj^] , where a = [a™ |„ig»] • 
Normally, we will use the symbol "b" to denote both the word b and 
the cylinder set it induces — the distinction will be clear from context. 
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For example, if is some measure, then "/^[b]" indicates the measure 
of the cylinder set defined by b. 

Whenever we speak of measures on St'^ , we will mean measures on 
the Borel sigma-algebra generated by the product topology. 

If is a G— module, then M.2is [21^] is the space of all G— invariant 
probability measures on 21^. This is a convex subset of M.£x; [Sl"^], 
the space of all probability measures on 2t^, which, in turn, is a 
convex subset of the real vector space Meas [21-^ ; M] of real- valued 
measures on 21^. 

The elements of M^as [21^; C] (compl ex-valued measures on 
21^) act as linear functionals on C(2l^; C) (the Banach space of 
complex- valued, continuous functions). This induces a weak * 
topology on J^Aeas [21'^; C] , making it into a locally convex topolog- 
ical vector space. 

M2is [2t^] is a compact subset oi Meas [21-^; C] under this topol- 
ogy 



When G = Z-°, we will refer to M2^ [21-^] as "X^ 



21^ 



liU C M, then M§^ [21^^] is the space of all locally G-invariant 
probability measures on 21^^. [21"] is the set of all extend- 

able probability measures: measures which can be extended to 
a G— invariant measure on 21^. Notice that: 

[21^^] is a compact, convex subset of M&is [2l'^;C] . 

This is because the marginal projection map pr^ : A4aAs [21^; C] — 
Meas [21^^; C] is linear and continuous, and A4^ [21^^] is simply the 
image of the compact, convex subset [21-^] under pr^. 

2 Applications 

2.1 Subshifts of Finite Type 

Let U C Z-^ be finite, and suppose that 20 C 21" is some set of 
"admissible" W-words. The subshift of finite type defined by 2IJ is 
the closed, shift-invariant subset of 21^ : 

(2IT) := {ae2t^" ; VnGZ-°, au+n^W^ 

One-dimensional subshifts of finite type were first studied by Parry 
JTzt and Smale |2^; excellent recent introductions arc |12| and 
Higher dimensional subshifts are closely related to tilings [13], |1J],]18], 
and involve many additional subtleties; see, for example ]|16[,|15|. Of 
particular interest is 
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The Nontriviality Problem: For a given set 22J, is the cor- 
responding set (2n) is even nonempty? 



The Nontriviahty Problem is known to be formally undecidable; 
see @, §, or 0. 



Theorem 1: Let U and 2U be as above. (W) is nontrivial if and 
only if there is some locally stationary probability measure fin on 21^ , 
with supp [flu] C (2n), such that fiu has a stationary extension. 

Proof: Suppose that such a fiu existed, and let ^ be a stationary 
extension. Clearly, any /x— generic configuration in 21 must satisfy 
the membership criteria of (22J}. Hence, (W) must be nonempty. 
Conversely, if (211) was nonempty, then by the Krylov-Bogoliov the- 
orem [p6| , there are stationary probability measures whose sup- 
port is contained in (2n}. Let fi be one of these measures, and 
let flu := pr^ [fi]. Then supp [fi] C W. □ 



Let [W] be the set of extendible measures supported on W. 



Corollary 2: It is formally undecidable whether, for a given 
subset *2IJ C 2t", the set [W] is nonempty □ 

However, it is easily decidable whether [W] itself is nonempty. 
The set of all real- valued measures supported on 2n is a finite-dimensional 
vector space, and the stipulation that an element of this vector space 
be a locally stationary probability measure takes the form of a finite 
system of linear equations and inequalities; solving such a system is a 
decidable problem. 



2.2 Cellular Automata 

Let U C 'E^ be finite (metaphorically speaking, U is a. "neighbourhood 
of zero" ) and let : Sl'^ — > 21. For every n G Z^, define (j)n ■= 
(/) o 5"" : 2t"+" 21. 

The cellular automata determined by is then the function $ : 
21^ — > 2t^ sending [a„|^g2;«] ^ [<l)n{au+n} Inez"]- </> is called 
the local transformation rule for <i>. Cellular automata were first 
investigated by Von Neumann and Ulam , and later extensively 
studied by Hedlund Wolfram |2^, and others; more recent surveys 



are 



11,1,1, i- 



Any cellular automaton on can be represented by a subshift of 
finite type on x Z. Simply define 
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U := (U X {0})U nO,0, ...,0, 

I D 

and then set 2U := |a £ 21" ; a(o,o,...,o, i) = (a(wx{o})) } 

a can be seen as a Z— indexed sequence of 
configurations in 21^ . Clearly, a is in (^20^ if and only if this sequence 

describes the $— orbit of some point in 21 . 

Of course, unless <i> is surjective, not every element of 21 will 
necessarily have a $— preimage, and thus, not every element can ap- 
pear in such a Z— indexed sequence of configurations. We can obviate 
this difficulty by concentrating on the center of the dynamical system 
(2t^°, $). 

If X is any compact space, and T : X — > X continuous, then the 
nonwandering set, il{X,T) is the set of all points x G X which are 
regionally recurrent: for any neighbourhood U of x, there is some 
n G N so that T"{U) nU n{X, T) is a compact T-invariant sub- 

set, so we can look at the restricted dynamical system (ri(X, T), T\n{x,T)) 
— however, not all elements of ^{X, T) will be regionally recurrent un- 
der T, when seen in the subspace topology (see for an example) 
— hence, f2^(X, T) Vl {p,{X,T), T|q(x,t)) may be a proper subset. 

By transfinite induction, for any countable ordinal number a, define 
fl"+i(X,T) := n {n{X,T), T|n-(x,T)), and, if 7 is a limit ordinal, de- 
fine W{X, T) := nQ<'y T). Since X is compact, this descending 
sequence of compact subsets must become constant at some countable 
ordinal a, so that ^1°'+'^{X,T) = n°'iX,T). The center of (X,T), de- 
fined Z{X, T) := T), is nonempty, compact, and T— invariant. If 
H is any T— invariant Radon measure on X, then supp [fi] C Z(X, T). 

So, treat (2t^°, $) as a compact topological dynamical system, 
and let Z($) be its center. The restricted map $1 : Z($) — > Z($) 
is surjective, so every element in Z($) appears in some Z— indexed 
sequence of 21 —configurations admissable to 2U. 

The Invariant Measure Problem: Given a local transfor- 
mation rule (p '■ 2t" > 21, describe the set of ^—invariant, stationary 

measures on 21 . 

Suppose that we represent the cellular automata as a subshift of 
finite type in the aforementioned way, and suppose that /Xjj is a lo- 
cally stationary probability measure on 21^^. It is easy to verify that 
a stationary extension of /ijj to 21^ is equivilant to a $— invariant, 
stationary measure on 21 . 
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3 Caveats and Counterexamples 



3.1 Nonextendability in Z; The Entropy Metric 

The following counterexample, which first appeared in shows that, 
even in Z, locally stationary measures are not always extendible, when 
the initial domain is "disconnected" . 

Suppose that U :— {0, 1, 3}. If nu is a probability measure on 
then we can treat the functions prQ,pr]^, and prg as random variables 
ranging over the domain 21. So, let be any probability measure on 
21" such that: 

• (A) prQ = prj^, ^z^— almost-surely. 

• (B) prp and prg are independent as random variables, (thus prj^ 
and prg are also independent.) 

To ensure is locally stationary, it suffices to require only that 
the random variables prg, pfi, and prg are identically distributed. 

The measure cannot be extended even to a locally stationary 
measure on 21 '^ '^l, much less a stationary measure on 2t^. To see this, 
suppose that /i[o..3] was a locally stationary extension. Then condition 

(A) defining implies that, as random variables on the probability 
space (21 Ai[o..3]) , prp — pr^ = pr2 = prg. But by condition 

(B) , prp and prg are independent — a contradiction. 

This example can be understood as part of a more general phe- 
nomenon. If iS is any set, and /i is any probability measure on 21"^, 
then ji induces an entropy metric, D^, on the set \S\ of all finite 
subsets of S. If W, V C 5 are finite, then define 

H^[U\V] ■■= -J2 J2 A*[a|b]log2(^[a|b]), 

r 11,1 M {c e 2t'^ ; ci^ = a and cy b} 

where «ab := — — = — -. 

' ^ {c G 21-5 ; cv = b} 



Then define: Df,[Vl, V] := Hf,[U\V] + H^[V\U]. 

It is easy to check that I?^ is a metric on J-i^ [S]. Furthermore, 
if iS is a G— module, and /i is a G— invariant measure, then I?^ is a 
G— action invariant metric. If 5 is a subset of some G— module, and 
/X is a locally G— invariant measure, then is a "locally" G-invariant 
metric, in the obvious sense. 

Now, suppose is a G— module, U C M, and fiu is a locally 
G— invariant measure on 21". If /x is to be an invariant extension of 
then it must satisfy the condition: 
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For every V,W £ J-in[U], and every g G G, D^[g.V, g.W] — 

Hence, Z?^ is forced to take certain values on a subset of [A^]- 
The question is: can we define in the rest of J-in [M] so that it is a 
metric? If we cannot, then it is impossible to extend fi. 

In the aforementioned counterexample, Z)^^ [{0}, {!}] = 0. Thus, 
if fi was an extension of fiui we would have: 

[{0}, {!}] = D, [{!}, {2}] = [{2}, {3}] = 

and hence, Z?^ [{0}, {3}] = 0. But we know that [{0}, {3}] > 
0, because prp and prg are independent random variables. Hence, no 
such extension fi can exist. 



3.2 Nonextendability in Z^; The Tiling Condition 

In the previous counterexample, it seems the problem was that the 
domain U was not "connected". However, in Z^, extendability can fail 
even when W is a 2 x 2 box. 

Suppose U C Z^, and fiu e [^^]. The support of fiu is 

some subset supp [/xt/] C Sl'^; let (supp [^j^]) be the subshift of 



finite type defined by supp [^lu] . If /i G A4i 



is a stationary 



extension of fiu, then any /i— generic configuration a G must be 
an element of (supp [^u])- 
Thus, we have: 



The Tihng Condition: cannot be extendible unless (supp [/i 
is nontrivial. 

Intuitively, the configuration a determines a tiling of by el- 
ements in supp [^k] : for any k G , ajk^^^) is an element of 

supp [fiu]- 

For example, suppose that D :— 2, U :— [0..1] x [0..1], and 21 := 
{0, 1, 2}. Elements of 2l" are thus 2x2 words in 2t. 

Choosing a configuration in 21^ is equivalent to assigning a 2 x 2 
matrix to each point in the lattice, so that adjacent sides agree. For 
example, the configuration in Figure |l| is equivalent to the assignment 
of Figure ^ 

We will define a locally stationary measure so that supp [nu] 
cannot tile in this manner. Wc will do this by explicitly constructing 
supp [nu] to tile a different space instead — a kind of "pseudolattice" 
(see Figure |3|). 
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2 1 1 
10 10 1 
2 12 12 
1111 
10 1 



Figure 1: A configuration of letters 



I I I I 








2 




2 1 




1 1 


1 


< — > 


1 


< — * 


1 


< — > 


1 


I 


I 




I 




I 


1 




1 




1 




1 


' 2 1 


i — ) 


1 2 


< — > 


2 1 


i — > 


1 2 


: 


: 




I 




: 


2 1 




1 2 




2 1 




1 2 


' 1 


< — ) 


1 1 


< s 


1 1 


i — > 


1 1 


: 


I 




I 




1 


1 




1 1 




1 1 




1 1 


1 


< — ) 


1 


< > 





i — > 


1 


: 


I 




1 




: 



Figure 2: The corresponding assignment of matrices. 



Stack two 3x3 grids on top of one another, and then "break" the 
connection between the central element of each level, and its south- 
ern, eastern, and western neighbours. Cross-connect the eastern and 
western neighbours with each other. Connect the southern neighbour 
to the central element of the level above, and we connect the central 
element of this level to the southern element of the level below. We also 
maintain the connection between the central element and its northern 
neighbour. 

Now we'll form a locally stationary measure which tiles this space 
instead. Consider the tiling portrayed in Figure ^ Count every element 
q£ 2^2x2 j^Qjyy times as it appears in these two pictures. There are 
18 tiles, and each one appears exactly once. Thus, each of the tiles 
shown gets a probability of jg. 

To show that fin is locally stationary, it suffices to check that the left 
columns and right columns have the same probability distribution, and 
that the top and bottom rows have the same probability distribution. 
This is easy to confirm. 

We claim that one simply cannot tile 1? with this collection of 

blocks. For example, as soon as one lays down a tile of the form 









6 


6 



1 


4 









one is forced to place a tile 
the only tile which will "match' 
place the tile 



9 1 

10 



to the left of 



immediately above it, since this is 
Once one has done this, one must 
and the tile q to its right. 



1 


4 









So far, all the tiles are compatible. However, now, what tile shall we 
lay down below 



9 1 

10 



? To be compatible with 



9 1 

10 



this tile's top row 



should read 



However, to be compatible with the tile 



immediate right, the tile's right-hand side should read | 
no tile in our collection which meets these two criteria. 



6 6 to its 



There is 



The Tiling Condition is necessary, but not sufficient. To see this, 
recall that the set M-i^ [U] is closed as a subset of [U]. Thus, 
its complement is open. Hence, every nonextendible measure is sur- 
rounded by a neighbourhood of nonextendible measures. 

If (3 is the equidistributed measure (assigning equal probability to 
every element of 21^^), and e > is small, then consider the measure: 



fit ■■= {1 - e) ■ fiu + e ■ f3 

fie is a convex combination of fin and f3. Since e > 0, the support 
of fie is all of 2t^. Thus, fie always satisfies the Tiling Condition. 
However, if e is "sufficiently small" , the measure fie will be inside the 
neighbourhood of nonextendible measures around fiu- 
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Figure 4: A configuration on the pseudolattice 
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4 Harmonic Analysis of Extensions 



4.1 Configuration Space as a Compact Group 

Solving the Extension Problem requires a good way of describing mea- 
sures, and Harmonic Analysis provides one. To employ this approach, 
wc must rcconccivc the configuration space as a compact abelian 
topological group. Hence, from now on, we will operate under the 
assumption that: 

The alphabet 21 m a finite abelian group. 

The choice of group structure on 21 is unimportant — if 21 has A 
elements, then the simplest choice is to let 21 := Z/A. 

If we endow 21'^ with the product group structure, it is a compact 
abelian topological group. What is its dual group? 

Let 21 be the dual group of 21. li V C A4 is finite, and, for all 
V £ V, Xt) G 21, then Xv ° pr^ : 21-^ — > is the map taking the 
configuration [amlTOeA^] *° value XviO'v)- (Here "T^" is the unit 
circle group.) 

We will use the notation " Xv" to refer to the map: 

vev 




It is easy to verify the next theorem: 

Theorem 3: Let M be any set. The dual group of 21-^ is tlie 

set: 

Xv ', V C A4 is any finite subset, and, for all v gV, Xi; S 21. > 
vev J 

□ 



4.2 The Fourier Transform 

Now, if /X is a measure on 21-^ , and x G 21-^, then the Fourier 
Coefficient of /z at x is defined: 

= (m, x) ■■= X dn 
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The Fourier Transform of /i is tlie function: 'p, : 21-^ — > C so 
that p.^ = {n, x). 

If AAeas [21-^; C] is endowed with the total variation norm, and 

C(2l-'^; C) is endowed with the uniform norm, then the map 
: Meas [a-^; C] — > C(2l^; C) 

is an injective, bounded linear function of norm 1 |]. Thus, 
the Fourier transform of fi totally characterizes it: if fi and v are two 
measures, and /I = 9, then fi = i^. 

4.3 Fourier Theory and (local) Stationarity 

The shift action of G upon 21-^ induces a right action of G upon 21-^ . 
If g e G, and x £ 2t-^, then define: 

X-g = X ° ' (1) 

Note that, if x = YiiXv °PT^v) , then x-g = H ° P'"g-'') 
v£V vev 

If W C is not closed under the G— action, then there is no "shift 
action" on 21^^. However, we can still treat G as "acting" upon 21^^ in 
a certain limited capacity, as follows: 

Suppose V CU, and x — Uvev (Xi" ° P^v)- Suppose that g £ G 
is such that g.V C U also. Then x-g = Il^ev {Xv ° P^g.v) is still an 
element of 21^. 

Theorem 4: 

1. If ^ ^ J'AzAs [21-^] , then ji is invariant if and only if, for every 
X e 2t^ and every g e G, (/i, x) = {^^, X-g) 

2. IfUcM, and ^ e Meas [21^^], then ^ is locally G— invariant if 
and only if, for every x G 21^ and every g G G so that x-g is aJso 
in2t", (^i, x) = (m, X-g)- 

Proof: We will prove Part 2, since Part 1 clearly follows. 

Proof of "=>": Let x = 0t,evX"' some V C U. Then a 
simple computation reveals: 
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Where, by "^[a]", we mean /i {b e 21^ ; by = a}. Thus, 



(M,X-g> =(1) E M[a]-(xo5,s (a)^ 

= (2) E ^ [•^fi^l ■ ° O 51 ( 



E ^ [4yta] • x(a) 

=(3) E ■ 
(M: x) 

(1) By definition of x.g (equation (|l|)). 

(2) Because i5it : St'^ — ^ St^ '^ is an isomorpliism. 

(3) Because fi is locally G— invariant. 

Proof of "<=": If V C is finite, then for any a e 21^, then it 
is easy to verify that: 

The argument is then very similar to that of . □ 



4.4 Fourier Properties of Stationary Extensions 

Suppose that U C M, and V C W is a finite subset, and suppose that 
X •= 0i,gv X-u is some element of 21^. Then we can also think of x as 
an element of 21-^. In other words, 21^ embeds canonically in 21-^. We 
will "abuse notation" , and identify elements of 21^^ with their images 
in 21-^. The following theorem is a straightforward computation: 

Theorem 5: Let ^lu e [2l"; C] , and Jet e M^as [21-^; C] . 

Then pr^ M = m ^ Vx £ 2F, (a^, x) = {t^u, x) • 
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.□ 



Thus, we have reduced the Extension Problem to finding a measure 
on Meas [2t^] whose Fourier coefficients agree with those of fiu on 

21*^ . However, we can't just "fill in" the remaining Fourier coefficients 
in an arbitrary way. First of all, we must produce something which 
is G— invariant. Second of all, we want to end up with a probability 
measure. 

Theorem 6: Let nu e MS>s [21"] , and let fi e A4aAs [2t^] . 
Then fi is a stationary extension of fiu if and only if the following two 
conditions are satisfied: 

• For every X , and every g e G, (a*, X-g) = (m, x)- 
(This equation must be true even when xs longer in 2t^J. 

• The Fourier coefficients of ji form a positive definite sequence. 

Proof: The first condition follows from Part 1 of Theorem ^. 
Notice that, if more than one G— translate of x lies inside Sl'^, then 
all of them will produce the same equation, by Part 2 of Theorem 
^ (since fiu is locally G— invariant). 

The second condition is just the Bochner-Herglotz theorem to guar- 
antee that the measure /i is nonnegative This forces /i to be a 
probability measure, because now ^[St-'^] = (a*;!) = (a^l/, 1} = 
/ijY[2t^] ~ 1. (since fj^u itself is a probability measure). □ 



5 Extension on Finite Modules 

Suppose that Ai is a finite G— module, U C Ai, and and G 
■M^ [St'^] . We will show that if fiu is "sufficiently close" to a product 
measure, then it is extendible. More generally, we will show: 

Theorem 7: Let vu G [21^] be an extendible measure, 

with an invariant extension v such that supp [i/] = Sl"^ . 

There exists an e > so that, if fiu G [Sl'^] is any measure 

with \\^J,u — i^Wvar < then is also extendible. This e is of the 
form: 

e = , ■ min v[a\ 
H{M) aea^i 

(miUjjgaAi i^[a] > by hypothesis that supp [i^] = 2t-^J, where 
H{A4) is a number determined by the module structure of M, and 
which satisfies the following bounds: 
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• (A) 

• (B) 



H{M) < CL, 

H{M) < CLi [G/H] - (Li [a'^ 
where H is the stabiliser of M in G: 

H := {h e (G ; Vm G A^, h • m 



m} 



Proof: Define Su := fJ-u ^ i^u- Thus, Su is a real- valued measure. 
Since fiu and i'jy are locally G— invariant, du is alsc|^. 
Next we will define 6, a real- valued, G-invariant measure upon St^^, 
in terms of its Fourier coefficients. For every x G 2t^, 



If there is some k e 21^^ and g in 

Six) 

Otherwise, let 6^ ■— 0. 



so that X = '^■gj then let 



By Part 2 of Theorem ]^ the definition of is independent of the 
choice of k and g, if more than one choice is available. By Part 1 
of the same theorem, the measure S is G— invariant. 
Claim 1: 5 is a real-valued measure. 

Proof: Since Sn is a real-valued measure, we know that, for 

every x G Sl*^! ix) = ^uix)- It follows that, for every 

X G 21^, ^ (x) = (^(x)! and from this, wc conclude that 6 is 
also a real- valued measure □ [Claim 1] 

Claim 2: Tliere is a number H{Ai), determined by the G— module 
structure of A4, and satisfying inequalities (A) and (B), so that 
< HiM)-\\Sut,,. 



Proof: 



From elementary harmonic analysis 

< ¥u\\yar- 



WC know that: 



< 



Hence, it suffices to show that 



< H{M) 



where 



H(M.) is the aforementioned number. To see inequality (A), no- 
tice that 



< G,^ [M] 



CLi [M] 



where the second equality follows immediately from the definition 
of 5. 



^ Cylinder subsets of 2l" can have negative (5^— measures, but these measures are still 
preserved under any shift which leaves the cylinder set inside 21^^. 
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Now for inequality (B). For any x G 21^, let G-x '■= {g-X i g G 'G} 
be the orbit of x under the action of G. Then: 



E E 1^(0 
E E 

^ CL^ [G.x] • |^(x) 



But for any x S 2t", 
is less than 



Cm [G-x] < Crd [G/M]. So this expression 



^ Gni [G/m] ■ \Suix) 



[G/H] 



< (Ld [G/H] • CLrf 



21" 



<5w 

□ [Claim 2] 



Recall that v is some invariant extension of vu. Define: 

fj, := v + 6 

Claim 3: /x is a nonnegative, G— invariant probability measure. 

Proof: /u is a sum of two real-valued, G— invariant measures, 
and thus is also a real-valued, G— invariant measure. 
Also, = \\S\lar < H{M)-\\du\U^^ = H{M) ■ 

K -MwLar- Thus, 



'"'"^ ^ ^ H{M) aea-^ 



mm via] 



For every a G 21-^, /Lt[a] > 0. 



It remains to show that /ifSl-'^] = 1, or. cquivalcntly, that (/z, 1) = 
1. Since {v, 1) = 1, this is equivalent to showing that {5, 1) = 0. 
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But (5,1) = {5u, t), a.nd {Su,t) = {m,"^) - {nu,"^) = 0. 
□ [Claim 3] 

Finally, we want to show that fi is an extension of jiu- But 

□ 

If /9 is a probability measure on 21, let be the corresponding 
product measure on 21^^. 

Corollary 8: Let M and H{M) be as in the previous theorem. 
Let p be a probabiUty measure on 21 with full support, and let 



min p[a) 



H{M) V«ea 



Let U c M. If fi G [21"], and < e> then fi is 

extendible. 

Proof: extends to the G— invariant probability measure p-^ on 

/ \(inl[M] 

A4, and min p^'^fal = I minp(a) | . □ 



6 Envelopes: Reduction to Smaller Mod- 
ules 

Suppose that M and M are G— modules, and that : M — > M 
is a G— module homomorphism — that is, for all m e and g G 

G, (f>{g.m) = g.(j){m). 



If a 



a™ L ~ € 21-^ , then define the element a := \a 



mlmeMi 



21-^, by the formula: 



Vm G M, am ■■- a^im) (2) 

This determines a function 21'^ : 21-^ — ^ 21-^, where 21'* (a) := a. 

If /i is a G— invariant measure on 21-^, we define the puUback of 
p through (f) to be the measure: (f^p (2t'*)*/z. It is easily verified 
that (f^p is a G— invariant measure on 21'^. 

Given a G— module M, a subset U C A4 and a locally G^ invariant 
measure pu on 21", we want to find a smaller G— module M, a subset 
U C M, and a locally G— invariant measure p^^ on 21", such that, if 

we can extend p^ to a G— invariant measure p on 21-^, then p := (f^p 
is an extension of pu 
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Definition 9: Envelope 
Let M be a G— module, and U C M. 

An envelope forU is a G— module A4, along with a G— module 
homomorphism (j) : M. — > A4, such that 

• (El ) When restricted to U, the function (p is injective. 

• (E2) IfV C U, then for anjg G G such that g.^(V) C 
we can find some element g e G so that: 

1. g.Vcu, 

2. For aU v € V, (j){g.v) = g.(j){v). (Thus, (j){g.V) = 



Example: Envelopes in a Lattice 

Suppose G = = Z^, and let U C be finite, and small 
enough that it fits into a box of dimensions Ni x N2 x ■ . ■ x Nn- We 
will indicate the action of on itself with the "+" symbol. 

Consider the Z^— module: 

~ z z z 

M := 



2NiZ 2NdZ 2NdZ 
and let (j) : A4 — > A4 be the Z^— module homomorphism: 

/ z z z 

(j){ni,...,nD) := ni + , n2 + ---^, no + 



2iViZ' ' 2NdZ 

Then (M, <j)) is an envelope for U. 



Remark: In this example, the module 

~ z z z 

A/f •— V X X 

iViZ 7V2Z NdZ 

with the quotient map : M — > M. would not necessarily have 
worked as an envelope for U. To see this, suppose that 

U := [L.TVi] X {1} X {1} X ... X {1} 

and let V := {vi, V2}, where Vi := (1, 1, 1), while V2 := 
(2,1,1,...,!). Let g := (iVi-1, 0, 0, . . . , 0) e G. Then note that 

g + fACvi) = <^(g + vi) = <^(7Vi,l, !,...,!) = </.(v3), 
where V3 := (iVi, 1,1,..., 1), while 
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g+0(v2) = 0(i+V2) = </)(7Vi + l,l,l,...,l) = 0(1,1,1,...,!) = 0(vi) 

Now, there is no element g g G so that g + V = {vi, V3} . 
Thus, although g + 0(V) C we cannot find some g G G so that 

g + V C W and (?!)(g + V) = g + (j){V). 



Proposition 10: Let M be a G—module, and U c M. Let 
(j) : M — > M be an envelope for U, and U :— (j){lA). 

1. For any probability measure fiu on Sl'^, there is a unique proba- 
bility measure Jljj on so that = (f^Jl^. 

2. If iiu is locally Q— invariant, then so is Jlq. 

3. Ifjl is an extension ofJiQ to a G— invariant probability measure 

on , then v :— (f^Ji is an extension of fiu to a G— invariant 
probability measure on 21-^, 

Proof: 

Proof of Part 1: By hypothesis, (t>\ : U — > U is injective. Let 
ij} '■ U — > U be the inverse map, and define Jiq := if^nu- Thus, 
— ^V-u' Si'^ce (f)\ij is injective, the measure Jiq is the unique 
one satisfying this equation. 

Proof o^Part 2: Let V CU, and c e Sl""^. Suppose g £ G is such 
that g.V C W as weh. We want to show: 

Let V := C U, and let c := 2t'^(e), where Sl"^ : — > 21^ 

is as defined by equation (^) near the beginning of Thus, if 

c = |c^,|^^^|, thenc = {c„|^g^}, where, for all w e V, c^, := C0(^). 

Let C be the cylinder set in Sl'^ associated to c (and likewise, C for 
c). Thus, C — 21''^ (C). Since Ai is an envelope, there is a g G G 
satisfying condition (E2). By (E2)(l), i^l^ C is also a cylinder set in 
2t", and since is locally G— invariant, fiu [i^^ C] — fJ.u[C]. 

Claim 1: 2l'/'(4|. C) = ^1 C 

e , and suppose that a = (a) , 

where a := KLg^^] G Then 5 £ 2t^(4|* C) 



Proof: 



Let a 



as I 



ueu 
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■(1) 



Vu e V, a{s.<i>{v)) = c<i>(v) 



(1) Because, for all v & V, o-{^.4>{v)) = 0'4>{s-v) = o-s-v^ and 
Cv = c^{v) 1^ [Claim 1] 



Thus 



4 C = [21^(4?. C)] = tiu [41 C] = iiu [C] = 



Proof of Part 3: This is straightforward. 



_□ 



7 Embedding of Locally Stationary Mea- 
sures 

Suppose that {X, X, v) is a probability space, and T is a i^-prescrving 
action of Z,^ upon X. Let V : X — > 21 be a measurable function (ie. 
a 2l-labelled, measurable partition of X), and let : X — > 21^ 
be the map a; i— > (T"(a;)) • '^^^ projection of through 

is then a stationary probability measure on 21^" , called the stocheistic 
process induced by V and T. Call this measure r]. 

Suppose that U C Z'^, and fj,u e [21"]. The map V is an 

embedding of fiu in the system (X, A',!/; T) if pr^ [rj] = fiu- When 
can jjLjj be thus embedded? 



Theorem 11: Suppose that U C TP is finite, and that jiu lies 
in the interior of [21^] . Suppose that {X, X, u; T) is ergodic. 
Then nu can be embedded in {X, X, v; T). 

Proof: We will first show how to construct an "approximate" em- 
bedding for . The approximation method involves a certain degree 
of error, which can be exactly characterized and then compensated 
for. 



21^ 



be an 



Suppose [/ e N, so that U C B{U). Let ^l e 
extension of jiu- Then for any > 0, ^^B(N) •= P''^b(n) llA ^ 
locally stationary probability measure on 2t^W. Also, ifWo cS(iV) 
is any translation of U, then pr^^ [A*B(Af)] = MWo> where is the 
obvious "translation" of fiK to the domain Uq- 

The Rokhlin Tower Lemma for Z^-actions says that, for any 
e > and N there is a subset R G X so that the disjoint union: 
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iieB{N+U) 



has measure greater than 1 — e. 

Let a; G X be a generic point for R, and suppose we look at the 
"name" of x with respect to the partition {R, X\R}: for all n £ Z^, 
colour the point n "black" if T'^x G R, and "white" otherwise. Let 
TZ C be the set of "black" points. The Rokhlin Tower condition 
is equivalent to saying that the union: 



is disjoint, and has Cesaro density greater than 1 — e in Z . 



scheme to determine its value at every point in the Z^— orbit of x, 
in terms of the {R, X \ i?}— name of x (this is sometimes called 
"colouring the name of x" ). The scheme well-defines the values of V 
on the orbit of every generic point in X — thus, it defines V almost 

everywhere on X . 

Defining the value of V on the —orbit of x is equivalent to defining 
a function p : TP — > 21 — in other words, a configuration. Do this 
as follows: Let </> : TZ — > 21'^'-''^-' be some function so that, for each 
a G 21 ''(^^ the Cesaro density of the subset ^~^(a) inside TZ is equal 
to /XB(Ar)[a] (since the set TZ itself has a well-defined Cesaro density, 
such a function can always be constructed). For each u G 7?,, let 
Pb(jv)+u = '/'(u). This immediately defines p on "most" of Z^. 
Now, fix some o G 21, and label all remaining points in Z^ with the 
symbol o. 

The function P induces a stationary probability measure rj on 21^ . 
riu := p^li [t]] is "close" to nu, but slightly "enriched" in words that 
contain big blocks of the "a" symbol, while impoverished in words 
that don't. If we fix e > and iV G N, then rju = Fc^^lfiu], where 
Fe,N ■■ [21^^] — > [2t"] is an afRne function. 

So, if we want to actually produce the measure nu as an outcome 
of this procedure, we must find some i^n G [21^^] , so that fin = 

F€,n['^u]- In other words, in order to use this construction to build 
an embedding of fiu within X, we must find some N and e so that 
m G/at,, :=FN,e {M^ [21"]). 

Claim 1: For any 5 > 0, there exist e and N so that jC^ [Ie,N] > 
(1 - (5) • />> [ME^ [21^^] ] , where is the Lebesgue measure. 




To define a measurable function P : X 



2t, we will provide a 
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Proof: F^^N is af&ne, and thus, differentiable with a con- 
stant derivative, Df: iq. For any > 0, we can find a smaU 
enough e and large enough N that, for every & [21"] , 

||-F'e,A'[m] - mILar < '^i' Thus, for any 82 > 0, we can make 
Si small enough so that WD^^n — Id||^ < 62 (where ||-||^ is the 
operator norm). Thus, for any S, we can in turn make 62 small 
enough that the determinant of D^^^ is within ^ of 1. Thus, for 
large enough N and small enough e, F^^n : [2t"] — > I^^n 
is a diffeomorphism, and, if C^^ is the Lebesgue measure, then 
/>[Je,jv] > (1 - (5) ■ 0= [Ml^ [21"]] □ [Claim 1] 

Claim 2: For any fi in the interior of M.^ [21"] tiere exist e and 

N so that II G It,N- 

Proof: Identify AAsms [21"; R] with R®", endowed with an inner 
product. I^^M is convex, so if /i G [2l"] \ I^^n, then there is 

some unit vector v G R®" , so that 1^^^ C |w G R^" ; (w — ^, v) < o|. 
Fix /i, and regard mv as a function of v. The set 
|w G R^" ; {w - ^i, v) > ojnA^^ [21"] has nontrivial Lebesgue 
measure rriv ■ [M^ [2t"]], for some mv > 0. Since the unit 

sphere in R^" is compact, there is some M > so that > M 
for all V in the sphere. 

Let 5 < M, and, by Claim 1, find e and TV so that C'^[I^^n] > 
(1 - <5) • />s [M^, [21"]]. Then we have M ■ [M^ [21"]] 

> S-C"^^ [M^ [21"]] > [Mi^ [2t"] \/,,jv] 

> />s |w G R*^" ; (w - /i, v) > o| n [21"] > M-C-^ [M^ [21"]] , 
a contradiction □ [Claim 2] 

We conclude that any point fi in the interior of [21"] is in 
If^N for some e and N, and thus, can be "embedded" in the system 
{X, X, II] T) via the aforementioned construction. □ 



8 (quasi)Periodic, Ergodic, and Mixing Ex- 
tensions 

8.1 Periodic Probability Measures 

If P C , then a configuration a G 21^ is called P-periodic if, for all 
n G and p G P, a„+p = an- If (P) is the sublattice generated by P, 
and A4 := TLP j (P), with TP acting upon M. by translation, then hA is 
Z^— module. The quotient map : — > is a homomorphism of 
Z^— modules. Configuration a is P-periodic if and only if a = 21 "^a, 
for some word a G 21-^ (in the notation of Section 
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In generjiJ^ if is a G— module, Ai is another G— module, and 
(j) : M — > is a G— module homomorphism, then we will say that 
an element a G 21^ is A^-periodic if a = 21''^ [a], for some a S 21^. 

If /i is a G— invariant measure on 21-^, then /i is A^^jieriodic if 
the elements of the space (21^, /j,) are /i— almost surely At— periodic. 

This is the case if and only if there is a G— invariant measure Jl on 2t-^, 
such that = (j)^ [Ji] . 

8.2 Periodic Extensions 

Suppose that U C A4, and fi^ is a locally G— invariant measure upon 
21^^. Can we extend iijj to a periodic measure on 21-^? 

Theorem 12: Suppose that A4 is a finite G— module, a quotient 
of Ai via the map (j) : A4 — > A4, and an envelope for U. Let H{A4) 
be the constant described in Theorem |^ 

Let V be a Q— invariant measure on 2t^, with fuU support, and let 

e „, , ... ■ min V[a] 
H{M) aea" 

Let V = {^'^)*v, and let vu :— pr^ If is any locally 
G— invariant measure on 21^ so that \\^u — i^uWyar ^' ttien can 
he extended to a Q— invariant, A4— periodic probability measure on 
21^. 

Proof: Let U := (l){U) C M. By Part 1 of Theorem the 
measure Ji^ :— {(p^^J^nu is a locally G— invariant measure on 21^. 
Further, if :— pr~ [P], then — i'j;^!!^^^ < £• Since A4 is finite, 
we can apply Theorem |7| and extend Jlj^ to a G— invariant measure, 
pi, on aU of 2t^. ^ 

Now, define n := cf^lJl]. Then ^ is a At— periodic, G— invariant 
measure by construction, and also, pr^ [/i] — iiy. □ 



Corollary 13: The set [21^] Jias uontriviaHnterior in the 
space MaAs [2t"; R], and tie set of M -periodically extendible mea- 
sures has nontrivial interior within Ai^s [21^^] • 

Proof: Let p be any probability measure on 21 with full support, 
and let fxu '■= be the product measure on 21^^. In the notation of 
Theorem |l2|, p^J^s a G-invariant extension of , with full support, 
and induces a Ai-periodic extension of jiu to 21-^. Bj^Theorem 
[l^ , all measures in an open ball around p^u a-lso have A^-periodic 
extensions. □ 
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Corollary 14: Suppose U C "L^ is Enite, and fits inside a box 
of size Qi X Q2 X ... x Qd- Suppose tfiat P :— {Pi, . . . , Pd), wlieie 
Pi > 2Qi, P2 > 2Q2, ■■■,P2 > 2Q2, and let v he a P-periodic, 
stationary probability measure on 21^ . Let vu '■— pr^^ [v]- 

Tfiere is an e > (a function of P and v), so that, if fiu is any 
locally stationary probability measure on Sl'^ within e of vy in total 
variation norm, then has a P— periodic extension. □ 

For any P := (Pi, . . . , Pd), let 2l^° denote the set of P-periodic, 

stationary processes. 

If W C Z^, then let [2t"] denote the set of P-periodically- 

extendible measures: those elements of [21^] having an ex- 

tension that is P— periodic. The following facts are not difficult to 
verify: 

• A^Ss [21*^] is a closed, convex set. 

• If /X e Mis [21^^] and ly G M^s [2t"] , then any convex com- 
bination of and 1/ is inside [21^] , where, for each d G 
[1...Z?], Rd is the lowest common multiple of Pd and Qd- 

Let A4|2r [^^] be the set of all locally stationary measures possess- 
ing a periodic extension of any periodicity. It follows that [21^^] 
is also a convex set. 



8.3 Essentially Aperiodic measures 

Not every extendible measure has a periodic extension. This follows 
from the existence of essentially aperiodic tile systems — that is, 
sets of tiles which can tile the plane, but only in an aperiodic fashion. 
In [|l9j , Raphael Robinson exhibits a collection of six "notched" square 
tiles, which, along with their 4 rotations, will tile the plane, but only in 
an aperiodic fashion. We can code these six tiles as six 3x3 matrices 
in the alphabet 21 := {0, a. A, b, B, c, C} 



A 


C 


A 


B 





d 


A 


B 


A 


a 


C 


a 


B 





C 


a 


B 


a 



c 


c 



aba 
c c 
aba 



aba 
c c 
a B a 



aba 
b b 
a B a 



Each tile has a "0" symbol in its center, surrounded by four "cor- 
ners" and four "edges" . The tiles must be put together so that these 
corners and edges "match" according to the following mapping rules: 

• "b" edges must be matched to "B" edges. 
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• "c" edges must be matched to "C" edges. 

• Where four tiles meet, exactly three corners must be of type "a", 

and one of type "A" . 

These matching rules can be encoded as a subshift of finite type on 
the alphabet 21, defined by some subset C 21^^, where U := [1..3]^. 
Any configuration in ($H) corresponds to some Robinson tiling. Now let 
/X be a stationary probability measure on (fH), and let '■= pr^ [/"]• 
Then nu is a locally stationary measure, and supp [^u] = 

Wc claim that fiu is "essentially aperiodic" . To sec this, siippose 
that v was any extension of nu. Then supp [i'] C and thus, al- 
most every configuration in the probability space (2t^ , i^) is aperiodic. 



8.4 Essentially Periodic Measures 

At the opposite extreme arc essentially periodic measures: locally 
stationary measures which only have periodic extensions. 

For example, let 21 := {0,1} and U := [1...9] x {0,1}, and let 
05 C 21" be the set: 
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Wl 





wo 






In other words, all blocks arc of the form I '"'o I where wq and 
Wl are successive 8— bit binary numbers. Let W C 2t" be the set con- 
taining all elements of *B and all their horizontal cyclic permutations. 
03 defines a subshift of finite type, which contains only the orbit of 
a single, periodic configuration, having horizontal periodicity 9, and 
vertical periodicity 256. Call this configuration a 

If fiu is the measure on 2t" assigning equal mass to each of the 2304 
elements of 03, then /jk has only one stationary extension: the measure 
H which assigns equal mass to each of the 2304 distinct translates of 
a. Thus, fly is essentially periodic, with period 256 x 9. 

Note that the periodicity 256 x 9 is much larger than 2x9, which 
was the size of the initial domain U. Indeed, as this argument makes 
clear, the periodicity of essentially periodic measure can be made to 
grow exponentially with the size of the initial domain. 
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8.5 Ergodic Extensions 

A stationary probability measure fi on is called ergodic if any 
measurable subset U C 21^ which is invariant under all shifts has 
/^—measure either zero or one. The set of ergodic measures on 21^ , 



which we denote by "Ai^ 



21^ 



' , is exactly the set of extremal points 



oiMi 



21^ 



(see y or |g6|) Hence, every stationary measure can 
be approximated arbitrarily well as a convex combination of ergodic 
measures. 

If W C Z^, and fiu e [21^^], then we say fj, is ergodically 

extendible if it can be extended to an ergodic measure on 2t . The 
set of ergodically extendible measures will be written as [21^] " . 

Since the map pr^ : Msas 2l^° — > Meas [21^^] is linear, any ex- 
tremal point of [21^] has a pr^— preimage which is extremal in 
21^ . As a consequence, every extremal point of [21^^] 

is in 21^^] . Hence, every extendible measure on 21" can be ap- 

proximated arbitrarily well as a convex combination of ergodically ex- 
tendible measures. 



We will see in Section 8.6 that, in fact, "almost all" extendible 
measures are ergodically extendible. However, not every extendible 
measure is. To see this, suppose that U C is some finite domain, let 
21 and S be two disjoint alphabets, and suppose that fiu G [2t"] 
and i^u e [S^] are two extendible probability measures. Let 

r]u := ^fiu + ^i^u- Then rju is also extendible, and any extension 
of rju is of the form r/ :— ^fi + ^v, where /i and u extend nu and 

vu, respectively, rj can never be ergodic: 2t^° and are disjoint, 
shift-invariant subsets of (21 U S) , each having 77— measure ^. 

Proposition 15: Let U he Gnite. 

1. Every ergodically extendible measure on 21^^ is a limit point of 
periodically extendible measures. 

2. [21^^] is a dense, convex subset of [21"] . 

3. [21"] contains the entire interior of [21"]. 

Proof: Part 2 follows immediately from Part 1, and the fact that 
[2t"] is convex, and the fact that [21"] is the convex 

closure of [2t"] . 

Proof of Part 3: This follows from Part 2, and the fact that, if 
C a dense, convex subset of a D-dimensional convex set K, then C 
contains int [K]. To see this, let x G int [K], and let B be an open 
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ball around x inside of int [K]. Let S be the boundary of B, and let 

si, . . . , sd be D equidistant points in S, so that their convex closure, 
co{si, ...,51)} is a regular £)-simplex containing the centre-point x. 
Since C is dense in i^, C n -B is dense in B. Thus, find ele- 
ments ci, . . . , C£) e C so that, for all d E [1..-D], Cd is "very close" 
to Srf. Then co{ci, . . . ,Cd} C C is a D-simplex "very close" to 
co{si, . . . ,sd}, and therefor contains x. 
Proof of Part 1: Let nu G [Ol^] , and let fj, be an ergodic 
extension of fiu- Let a G 2t^ be a generic configuration for ji: in 
other words, for any finite subset V C and configuration b £ 21^, 

At[b] = lim Freq [b C a; B{N)] 

JV— >oo 

where B{N) := [O...N)^ is the D— dimensional cube of side length 

N, and 



# of times "b" appears inside aB(jv) 
Freq[bca; S(Af)] := ^^^^ ^ 

= 7^ 5Z l{av+n = b} 

nGB(Ar) 

Such generic configurations exist, by the Birkhoff Ergodic Theorem. 
In particular, for any e > 0, we can find a large enough N so that, 
for all b e 21", 



Ai[b] - Freq [b C a; B{N)] 



e 

< 2 



Suppose that all of U fits inside a cube of side length U. Assume 
that N is so large that the {/—thick boundary of B{N) is "relatively 
small" : 

Om [B{N)] - Cm [B{N - U)] e 
dm [B{N)] ^ 2 

Now, identify B{N) with A/" := {Z/N)® . . .®{Z/N), and treat ast^m 
as an element of 21-'^. Then this configuration, along with its N 
periodic translations on 21-'^, defines a stationary measure on 
which, in turn, defines an A/"— periodic, stationary measure on 21^ . 
Call this measure v, and then let uu := pr^ [p]. It is straightforward 
to verify that 

\Wu - Mwll < e 
and of course, by construction, i/u G [21^] . □ 
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8.6 Mixing, Weak Mixing, and Quasiperiodicity 

A stationary probability measure /i on is called weakly mixing if 
the stochastic process (21^ x 21^ , /j, (g) /i) is ergodic. fi is called mix- 
ing if, for any measurable A,B C 21^ of nonzero measure, any any 
sequence {n/clj^^^} C tending to infinity, limfe^oo M [^ni5"''-S] = 
li[A] ■ fi[B]. A function e L2(21^ , ^) is an eigenfunction of the 
system (2t^° , /i) if there is a group homomorphism x ■ — * 
such that, for all n S Z^, 55t('/') = xC'^) ' 4'- The system is called 
quasiperiodic if L^(2l^ , /i) has an orthonormal basis of eigenfunc- 
tions. 

All of these concepts can be defined for any measure-preserving 
Z^— action on a probability space {X,X,fi). Mixing implies weak 
mixing implies ergodicity, but weak mixing and quasiperiodicity are 
mutually exclusive. Furthermore, all of these properties are inheri- 
table through morphisms. If {X,X,^; T) and (AT, A",/}; T) are two 
measure-preserving Z^— actions, then a morphism between the sys- 
tems is a measure-j)reserving surjection : X — > X so that, for all 
n G Z^ , o T" = T" o . If is such a morphism, and (A, A", /x; T) is 
ergodic (respectively: weakly mixing, mixing, or quasiperiodic), then 
so is (A, f). 

In particular, let F : A — > 21 be a measurable function, so that F 
and T together induce a stationary stochastic process on 21^ , having 
measure /I (see Section If A :— supp [/i] C 21^ and T := 

then the map F^" : X — > 2l^° is a morphism. Thus, if {X,X,fi; T) 
possesses any of the aforementioned inheritable properties, so does the 
process (21^ 

Theorem 16: Suppose that U c lP is finite, and that nu is 
in the interior of [21^] . Then nu can he extended to a sta- 

tionary process /i which is any of: ergodic, mixing, weakly mixing, or 
quasiperiodic. 

Proof: The argument is the same in all four cases. First, find a 
system (A, X, v; T) which is ergodic, and which also has the prop- 
erty in question (for the first three, this is trivial; for the fourth, 
it is sufficient to know that ergodic, quasiperiodic systems exist). 
Next, use Theorem pi] to embed within the desired process. Let 
e 21^ be the stochastic process generated by this embed- 
ding. Then /i itself has the desired property. □ 

The same argument works for any other "inheritable" property of 
dynamical systems. The interpretion: knowledge of the local marginal 
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fjLu tells you basically nothing about the asymptotic dynamical prop- 
erties of the process /i. 

9 Decidability Questions 

In section we showed: 

It is formally undecidable whether, for a given subset 
an C 21", the set Mg^ [W] is nonempty. 

This raises the question of whether the Extension Problem itself is 
formally decidable. 

Let M-f be the set of all recursively computable (r.c) real num- 
bers: that is, real numbers whose decimal expansion can be generated 
by some Turing Machine Q. is a countable field, containing all 
rational and real-algebraic numbers. Let A^£4S| [21^; R] be the set of 
r.c, real-valued measures: those such that, if V C is finite, and 
a e 21^, then the measure of a is an element of R|. (Of course, some 
"exotic" measurable subsets of 21^ may have non r.c. measures). 
Meas-^ [21^; M] is a vector space over the field R|. 

Let [21-'^] be the set of G— invariant probability measures, 

etc. Clearly, when we ask about the "formal decidability" of the Exten- 
sion Problem, what we are really referring to is the Extension Problem 
for r.c. measures: 

IfU C M, and flu e [2t"], is fi extendible to a 

G— invariant measure on 

Note that we do not require the extension itself to be r.c. If a 
recursive decision procedure explicitly constructs an extension, then 
this extension will be r.c. by nature. However, it is conceivable that 
some recursive decision procedure might exist which demonstrates the 
existence of an extension by "nonconstructive" means. It is conceivable 
that, although we can recursively decide that is extendible, no r.c 
extension exists. 

A subset S C A4Ss| [2l"] is called recursively decidable (r.d) if 
there is a Turing machine M, so that, when given any /i G A^Ss| [21"] 
as input, M halts after some finite number of steps, and outputs either 
"yes" or "no" , depending upon whether or not /i is an element of S . 

A subset S C A^lisj [2t"] is called recursively enumerable (r.e) 
if there is a Turing machine M, so that, when given any integer n G N 
as input, M halts after a finite number of steps, and produces as output 
some measure Fjain] £ S, and so that the function Fm ■ N — > S in- 
stantiated by M is surjective. In other words, M provides a mechanism 
to systematically "list" all elements of S. 
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Equivalently, S C A^£s| [St'^] is recursively enumerable if there 
is a Turing machine M, so that, when given any /i G A4^^ [St'^] as 
input, M lialts after some finite number of steps unless fi is not in S, 
in which case M never halts. 

The following facts are easy to verify: Any r.d set is r.e., but the 
converse is not true. However, if both S and its complement are r.e., 
then S is r.d. Finally, although a countable union of r.d sets is not 
necessarily itself r.d, it is still r.e. Q. 

Theorem 17: Let U cZ'^ be a finite subset. Then 

1. For any P e N^, M^s^ is r.d. 

2. Mi^\ [21"] is r.e.. 

3. M^^ [21"] \ M^^ [21"] is r.e.. 
Proof: 

Proof of Part 1: li ^iu [2l"~ 



the set 5" := |/i e 



2t" 



we want to know whether 
P^u M = m} is nonempty. 



Suppose P (Pi, ... , Pd)- Let M := (Z/Pi) (B . . .JS) (Z/Pd), 
and suppose that U maps bijectively into the subset U d A4 via 
the quotient map from — > M. Let pt^ e 21" be the 

projected image of ^u- 

The vector space of P— periodic, signed measures on 21^ is linearly 



isomorphic to the finite dimensional vector space Meas 
The image of S under this isomorphism is the affine set 



21^; 



5* := 1^ e Meas 



2t 



M. 



fi a stationary probability measure, and pr^ [/i] ^ ^J■^^ 



S is the solution set of a finite system of linear equations and linear 
inequalities in /i: 



= 1. 



• For all neZ^, 

• For all ae 2t^, 



Ai[a] > 0. 



Thus, it is r.d whether S is nonempty, and thus, whether /ij^ has a 
P— periodic extension. 
Proof of Part 2: A^Ias^ [2l"] is a countable union of recursively 
decidable sets, and thus, r.e.. 
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Proof of Part 3: Suppose /i e J^eas 



21^ 



has Fourier 



transform 
It is easy to verify: 



, let V C be a finite subset, and let a e 21^ 



Thus, if ^lu e [a"] , then by Theo rems ^ and |^, /i is an exten- 

sion of if and only if: 

• For all xe a", = (mW:X) 

• For all n G Z^, and all x ^ 21^" > if ^ X ° 5" then /i^ = Jl^. 

• For all finite V C and a e 21^, ^ A^x " x(a) > 0. 

Thus, an extension for fiu is equivalent to a set of Fourier coefficients 
satisfying a countable collection of linear equations and inequalities. 

For all N eN, let B{N) := [O...N]°, and let Sat := If N is 

large enough that U C B{N), then we can start by trying to define 
all the Fourier Coefficients in the set {^^ ; x G Sat}- The three sets 
of linear constraints listed above now become a finite system of linear 
equations and inequalities — if the solution set is nonempty, call it 
Sn- 

Claim 1: Suppose that, for all N £ N, the set Sn is nonempty. 
Then is extendible. 

Proof: Sn is a compact subset of the finite dimensional vector 
space C"". Furthermore, if Sn+i is also nonempty, then any 
vector in Sn+i, when projected to C"™, determines an element in 
Sn- Call this projection map pr^r. 

Fix N, and, for aU M > N, let S^' := pr^ o pr^r+i o . . . o 
prM-i('5'M), a nonempty compact subset of Sn. Also, S^^'^ D 
D S^^^^ D .... Thus, Sn ■-= r\M>NSff is a nonempty 
compact subset. Further, pr^r (•Sat+i ) = Sn- Thus, any element 



of Sn can be "extended" to an element of S'at+i, which can then 
be "extended" to Sn+i, etc. 

Pick any element /2jv G Sn, and inductively extend it in this 
fashion, producing JIm G Sm, for every M > N. Once this is 
done, the collection of vectors {A'A/Lf>N} defines a single element 
■j2 g (j^a*^ ^ jg |-]^g Fourier transform of some measure /i, and 
by construction, is a stationary probability measure, and an 
extension oi fiu ^ [Claim 1] 
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Hence, if is not extendible, then, by contradiction, there must be 
some A'' £ N so that Sn is empty. Since Sn is the solution set of a 
finite system of linear equations and inequalities, it is r.d whether 
Sn is empty. 

Hence, by successively checking the nonemptiness of Sn for each 
N G N, we have a recursive procedure which will halt if fJ-u is not ex- 
tendible, and tell us so. (If fiu is extendible, however, the procedure 
will never halt). Thus we can recursively enumerate the elements of 
M^^ [2t"] \ M^^ [a"] . □ 



Theorem 18: Let U CZ^ be Gnite. The set [21"] is not 

r.e.. 

Proof: Recall that, if T C 2l", then (1) is the associated subshift 
of finite type (see Section Let N := {T ; (1) is not trivial}, 
and let T := {T ; (T) is trivial}. Recall that N is not r.d (see @, 
§,or|0|). 

Claim 1: Suppose T C a'^. If 1 G T, then there is some N £ N 
so that no configuration in Sl'^'^^^ is 1—admissable 

Proof: Suppose that, for every N gN, there was a configuration 
al^l G 2l8(JV) that was T-admissable —that is: for all n e B{N), 
\in + U C B{N), then a|^^^ e 1. Extend al^l to an clement of 

21 by filling all the remaining entries in some arbitrary fashion 
— call the extended configuration b'^l 

Since 2t^ is compact, the sequence [bl^lj^gpj] has a convergent 
subsequence — call it [bl^*-'! — which converges to some limit 

be2t^°. 

For any M G N, there is some G N so that, for all k > 
K, b^j^^l^j = bg(M). Hence, the central "S(M)-block" of b 
is T— admissable. This is true for every M; we conclude that b is 
T— admissable. Thus, the set (T) is nonempty, since it contains b. 
□ [Claim 1] 

Claim 2: The set T is r.e.. 

Proof: Fix 1 C 21^^. For any finite N, it is r.d whether 
or not St^*-^-* contains a X— admissable configuration (there are 
only a finite number of cases to check). Suppose we perform this 
procedure for every N G N. By Claim 1, if T G T, then we will 
eventually find an N where no T— admissable configuration exists. 
Thus, we have a procedure which will halt if T G T, and tell us 
so □ [Claim 2] 

As a consequence, since N is not r.d, we conclude that N is not even 
r.e.. 
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Claim 3: Suppose that A^J^^ [^^] was r.e.. Then N is also 
r.e.. 

Proof: Clearly, N = |t C 21" ; for some ^ e TW^,^ , supp [ 
Hence, any recursive procedure for enumerating the elements of 
A^^l [St'^] would also provide a means for enumerating the ele- 
ments of N □ [Claim 

3] 

By contradiction, A4^, [St'^] cannot be r.e.. □ 



10 Conclusion 

Although [^^] itself is not recursively denumerable, both its 

complement and topological interior are (Section |^). As yet, however, 
no efficient procedure exists for determining when a locally stationary 
measure is extendible. So far the only substantive result in this di- 



rection is Theorem |12|, which says, loosely, that if fiu is "sufficiently 
close" to a periodically extendible measure with full support, then fiu 
itself is periodically extendible. 

The existence of mixing, ergodic, etc. extensions is well-characterized 



in Section B.E. However, as yet, no useful work has been done charac- 
terizing the entropy of these extensions. In particular, we might ask: 
given that nu is extendible, what do the maximal-entropy exten- 
sions of nu look like? Is the maximal-entropy extension unique! Does 
it possess some kind of "Markov" property, analogous to the Markov 
Extension in Z? Perhaps it is some kind of Markov Random Field 
pof . Indeed, in general, what would a "Markov extension" of a lo- 
cally stationary measure look like, if anything? In the nonprobabilis- 
tic, purely symbolic setting, the construction analogous to a Markov 
extension is a Z^-subshift of finite type, but these are still poorly un- 
derstood. Even topological Markov shifts — the simplest subshifts of 
finite type — do not generalize easily to higher dimensions p^ . The 
maximal entropy measures for such subshifts have been studied in ; 
perhaps similar techniques can be applied to maximal-entropy exten- 
sions of probability measures. 
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